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FIELD OF THE INVENTION 
[0001] The present invention relates generally to a differential lossless compression method and 
system and more particularly to a method of and system for encoding instruction bit 
patterns using a primary dictionary for the most frequently occurring bit pattems and 
encoding the remaining instruction bit pattems using the differences between the remaining 
bit pattems and the bit pattems that are already encoded in the primary dictionary. 

BACKGROUND OF THE INVENTION 
[0002] In order to reduce the amount of memory needed to store data processing instructions in on- 
chip SRAM memory, the instmctions are typically compressed to reduce the amount of 
memory that must be stored. Typical compression algorithms involve storing data words 
used in an instmction set in a look-up table and accessing the data words through the use of 
code words that identify the address at which the desired data word is stored. While this 
type of compression reduces the amount of memory needed compared to storing all of the 
necessary data words, it still requires a great amount of memory to operate properly. 

SUMMARY OF THE INVENTION 
[0003] The present invention provides a method of and system for performing lossless 

compression in which the most frequently accessed data words are stored in a primary 
dictionary and in which shortened code words are used to access these data words. 
Difference dictionaries are used to store difference bit streams which are accessed by code 
words which identify a data word in the primary dictionary and a difference bit stream in 
one of the difference dictionaries. An exclusive-OR operation is performed on the 



identified data word and the difference bit stream to calculate a decoded data word that is 
not stored in either the primary or difference dictionaries. 

[0004] According to one aspect of the invention, a method of decompressing data words of an 
instruction set includes: 

A. filling a primary dictionary with at least one primary data word of the 
instruction set, each of the at least one primary data word being stored in the primary 
dictionary in a location associated with a distinct primary dictionary index; 

B. filling at least one secondary dictionary with at least one difference bit stream, 
each of the at least one difference bit stream being stored in one of the at least one 
secondary dictionary in a location associated with a distinct secondary dictionary index; 

C. receiving a code word, the code word comprising: 

a. a header which identifies the primary dictionary and a specific one of 
the at least one secondary dictionary; 

b. a first bit stream; and 

c. a second bit stream; 

wherein the first bit stream comprises the distinct primary dictionary index 
and the second bit stream comprises the distinct secondary dictionary index; 

D. retrieving the primary data word stored at the location in the primary 
dictionary location associated with the distinct primary dictionary index; 

E. retrieving the difference bit stream stored at the location in the at least one 
secondary dictionary location associated with the distinct secondary dictionary index; and 

F. performing a logic operation on the primary data word and the difference bit 
stream to obtain a resultant data word that is not stored in either the at least one primary 
dictionary or the at least one secondary dictionary. 

[0005] The primary data words may include 32 bit words, the code words may include less than 32 
bits, the first bit stream may include up to 1 1 bits and the second bit stream may include at 
least 5 bits. The logic operation may be an exclusive-OR operation. The at least one 
secondary dictionary may include a first secondary dictionary which includes difference bit 
streams which are more commonly included in the second bit stream of the code word and a 
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second secondary dictionary which includes difference bit streams which are less 
commonly included in the second bit stream of the code word. 

[0006] According to another aspect of the invention, a system for decompressing data words of an 
instruction set includes: 

a computer processor which perfomis operations based on the instruction sets; 
a memory device including: 

A. a primary dictionary including at least one primary data word of the 
instruction set, each of the at least one primary data word being stored in the primary 
dictionary in a location associated with a distinct primary dictionary index; and 

B. at least one secondary dictionary including at least one difference bit 
stream, each of the at least one difference bit stream being stored in one of the at least 
one secondary dictionary in a location associated with a distinct secondary dictionary 
index; and 

a decompression engine for receiving a code word from the computer processor 
and accessing the memory device to decode the code word to obtain a data word 
requested by the computer processor; 

wherein the code word includes: 

a. a header which identifies the primary dictionary and a speciflc one of 
the at least one secondary dictionary; 

b. a first bit stream; and 

c. a second bit stream; 

wherein the first bit stream comprises the distinct primary dictionary index 
and the second bit stream comprises the distinct secondary dictionary index; and 

wherein the decompression engine retrieves the primary data word stored at the 
location in the primary dictionary location associated with the distinct primary dictionary 
index; 

retrieves the difference bit stream stored at the location in the at least one 
secondary dictionary location associated with the distinct secondary dictionary index; and 

performs a logic operation on the primary data word and the difference bit stream 
to obtain a resultant data word that is not stored in either the at least one primary 
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dictionary or the at least one secondary dictionary, the resultant data word being the data 
word requested by the computer processor. 

[0007] According to another aspect of the invention, a system for decompressing data words of an 
instruction set includes: 

a computer processor which performs operations based on the instruction sets; 
a memory device including: 

A. a primary dictionary including at least one primary data word of the 
instruction set, each of the at least one primary data word being stored in the primary 
dictionary in a location associated with a distinct primary dictionary index; and 

B. a first secondary dictionary including at least one difference bit stream, 
each of the at least one difference bit stream being stored in the first secondary dictionary 
in a location associated with a distinct first secondary dictionary index; and 

C. a second secondary dictionary including at least one difference bit 
stream, each of the at least one difference bit stream being stored in the second secondary 
dictionary in a location associated with a distinct second secondary dictionary index; and 

a decompression engine for receiving a code word from the computer processor 
and accessing the memory device to decode the code word to obtain a data word 
requested by the computer processor; 

wherein the code word includes: 

a. a header which identifies the primary dictionary and one of the first 
secondary dictionary and the second secondary dictionary; 

b. a first bit stream; and 

c. a second bit stream; 

wherein the first bit stream comprises the distinct primary dictionary index 
and the second bit stream comprises the distinct secondary dictionary index for the 
secondary dictionary identified in the header; and 

wherein the compression engine retrieves the primary data word stored at the 
location in the primary dictionary location associated with the distinct primary dictionary 
index, retrieves the difference bit stream stored at the location in the identified secondary 
dictionary location associated with the distinct secondary dictionary index; and 
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performs an exclusive-OR operation on the primary data word and the difference 
bit stream to obtain a resultant data word that is not stored in either the primary dictionary 
or the at least one secondary dictionary, the resultant data word being the data word 
requested by the computer processor. 

[0008] According to yet another aspect of the invention, a system for decompressing data words of 
an instruction set includes: 

processing means for performing operations based on the instruction sets; 
a memory means including: 

A. a primary dictionary including at least one primary data word of the 
instmction set, each of the at least one primary data word being stored in the primary 
dictionary in a location associated with a distinct primary dictionary index; and 

B. a first secondary dictionary including at least one difference bit stream, 
each of the at least one difference bit stream being stored in the first secondary dictionary 
in a location associated with a distinct first secondary dictionary index; and 

C. a second secondary dictionary including at least one difference bit 
stream, each of the at least one difference bit stream being stored in the second secondary 
dictionary in a location associated with a distinct second secondary dictionary index; and 

decompression means for receiving a code word from the computer processor and 
accessing the memory device to decode the code word to obtain a data word requested by 
the computer processor; 

wherein the code word includes: 

a. a header which identifies the primary dictionary and one of the first 
secondary dictionary and the second secondary dictionary; 

b. a first bit stream; and 

c. a second bit stream; 

wherein the first bit stream comprises the distinct primary dictionary index 
and the second bit stream comprises the distinct secondary dictionary index for the 
secondary dictionary identified in the header; and 

wherein the decompression means retrieves the primary data word stored at the 
location in the primary dictionary location associated with the distinct primary dictionary 
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index, retrieves the difference bit stream stored at the location in the identified secondary 
dictionary location associated with the distinct secondary dictionary index; and 

performs an exclusive-OR operation on the primary data word and the difference 
bit stream to obtain a resuhant data word that is not stored in either the primary dictionary 
or the at least one secondary dictionary, the resultant data word being the data word 
requested by the computer processor. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0009] The foregoing and other objects of this invention, the various features thereof, as well as the 
invention itself may be more fully understood from the following description when read 
together with the accompanying drawings in which: 

[0010] Fig. 1 is a schematic block diagram of a compression system according to a preferred 
embodiment of the present invention; 

[0011] Fig. 2 is a schematic diagram of the dictionaries utilized in the memory device in 
accordance with the preferred embodiment of the present invention; 

[0012] Fig. 3 is a schematic diagram of the code words utilized in the compression algorithm in 
accordance with the preferred embodiment of the present invention; 

[0013] Figs. 4A-4D are schematic diagrams showing the operation of the preferred compression 
algorithm; 

[0014] Fig. 5 is a schematic diagram of further lookup tables in accordance with the preferred 
embodiment of the present invention; and 

[0015] Fig. 6 is a schematic diagram showing the parameters involved in the weighting function in 
accordance with the preferred embodiment of the present invention. 

DETAILED DESCRIPTION 
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[0016] The present invention is directed to a method of and system for performing a lossless 

compression and decompression of 32 bit words of instruction sets. Fig. 1 is a schematic 
block diagram of a system 10 which includes a computer processor 12, an on-chip 
compressed memory device 14, such as an SRAM memory, and a compression engine 16. 
The 32 bit instruction set words are compressed in a manner described below, and stored in 
compressed memory device 14 for access by the processor 12. Compression engine 16 
decompresses the instruction sets on memory requests from the processor 12 that represent 
instruction cache misses or data fetches. Therefore, in the preferred embodiment of the 
invention, the decompression of the instruction sets does not affect the instruction 
performance of the processor 12, since frequently executed instructions are accessed from 
the cache associated with the processor 12. Accordingly, in multiple-processor systems, a 
single compression engine 16 is used per memory device 14 to decompress instruction sets 
for each processor. 

[0017] The preferred embodiment of the invention utilizes a compression algorithm in which the 
most frequently occurring 32 bit patterns of the instruction sets are stored in one of two 
primary dictionaries and less frequently used bit patterns are processed to determine a 
difference bit stream which, when compared to one of the bit patterns stored in the primary 
dictionary, result in the original bit pattern. The difference bit patterns are stored in one of 
two difference dictionaries. Specifically, the preferred embodiment includes four statically 
allocated dictionaries in which the bit streams required for enabling the compression 
algorithm to operate are stored. These dictionaries are shown schematically in Fig. 2. A 
short primary dictionary 20 includes the most popular 32 bit word accessed by the 
processor and a normal primary dictionary 22 includes the main body of 32 bit words that 
are frequently accessed by the processor. A short difference dictionary 24 and a normal 
difference dictionary 26 include difference bit streams which, as is described below, are 
used to calculate a 32 bit word that is not stored in either the short or normal primary 
dictionaries. In this context, the short difference dictionary 24 contains the difference bit 
streams that are most frequently accessed in order to calculate the 32 bit word, and the 
normal difference dictionary 26 contains the main body of difference bit streams that are 
accessed in order to calculate the 32 bit word. In this embodiment the short primary 
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dictionary 20, normal primary dictionary 22, short difference dictionary 24 and normal 
difference dictionary 26 can contain 1, 2048, 32 and 512 independently addressable entries, 
respectively. 

[001 8] The preferred embodiment of the present invention utilizes three different categories of 
code words to access the dictionaries necessary to identify the 32 bit word that is to be 
accessed. The first type of code word is a direct reference to an address in either the short 
primary dictionary 20 or the normal primary dictionary 22. The second type of code word 
includes a direct reference to an address in the normal primary dictionary and a reference to 
an address in either the short difference dictionary 24 or the normal difference dictionary 
26. As is described below, the difference bit stream located at the address referred to in the 
code word is compared to the 32 bit word located at the address referred in the code word to 
calculate the actual 32 bit word which will be utilized by the processor 12, The last type of 
code word is a directly coded 32 bit value, which results from a 32 bit word that cannot be 
compressed using the preferred algorithm. Accordingly, there are five types of code words 
that are utilized to determine which 32 bit word is being accessed by the processor. Each of 
the code words is identified by the header bits associated with each code word. The 
structure of each of these code words is schematically shown in Fig. 3, in which the bit 
index is shown across the top of the figure. 

[0019] Shown in Fig. 3 is a code word 30 used to access the short primary dictionary 20, a code 

word 32 which is used to access the normal primary dictionary 22, a code word 34 which is 
used to access the normal primary dictionary 22 and the short difference dictionary 24, a 
code word 36 which is used to access the normal primary dictionary 22 and the normal 
difference dictionary 26 and a code word 38 which is a directly coded 32 bit word that 
cannot be compressed according to the present invention. As shown in the figure, each of 
the code words is identified by the header bits associated with the code word. Although 
any combination of bits may be used to identify each of the code words, in the preferred 
embodiment of the invention, the header "00" is used to identify the short primary 
dictionary code word 30 which has a length of 2 bits, the header "1" is used to identify the 
normal primary dictionary code word 32 which has a length of 12 bits, the header "01 10" is 
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used to identify the short difference code word 34 which has a length of 20 bits, the header 
"0111 " is used to identify the normal difference code word 36 which has 24 bits, and the 
header "010" is used to identify a directly coded 32 bit word. 



[0020] Based on the foregoing, the decoding algorithm can be written as follows: 
CASE header OF 

size:=2; result:=lookup shortdictionary(0) 
size:=12; result:=lookup__normaldictionary(bits 1-11) 
size:=20; result:=lookup_normaldictionary(bits 4-14) XOR 

lookup_shortdifferencedictionary (bits 15-19) 
size:=24; result:=lookup normaldictionary(bits 1-11) XOR 

lookup_normaldifferencedictionary (bits 1 5-23) 
WHEN 010: size:=35; result:=bits 3-34 



WHEN 00: 
WHEN 1: 
WHEN 0110: 

WHEN 0111: 



[0021] Accordingly, compression engine 16, upon receiving a particular code word to decode, first 
reads the header bits to determine in which dictionary the associated 32 bit word can be 
found. Since the short primary dictionary 20 only includes one item, only the two bits that 
make up the header "00" are needed to identify the 32 bit word stored in the short primary 
dictionary 20. Therefore, when compression engine 16 receives a code word having the 
header "00", the 32 bit word stored in the short primary dictionary 20 is output to the 
processor 12. This operation is schematically shown in Fig. 4A. The code word 30 is 
received by compression engine 16, which identifies the code word as a reference to the 
entry in the short primary dictionary 20 based on the header "00". Compression engine 16 
then fetches the 32 bit word 40 stored at address A in the short primary dictionary 20 and 
forwards it to the processor 12. 

[0022] Code word 32 includes the header bit "1" and an 1 1 bit stream (bits 1-11) which identifies 
the address at which a particular 32 bit word is stored in the normal primary dictionary 22. 
This 1 1 bit length of bit stream enables a total of 2048 addresses at which 32 bit words 
may be stored in the normal primary dictionary 22. Therefore, when compression engine 
16 receives a code word having the header "1 ", it recognizes the code word as a normal 



9 



primary dictionary code word in which the 1 1 bits that follow the header identify an address 
in the normal primary dictionary 22 at which the 32 bit word required by the processor 12 is 
stored. This operation is schematically shown in Fig. 4B. The code word 32 is received by 
compression engine 16, which identifies the code word as a reference to the entry in the 
normal primary dictionary 22 based on the header "1". Compression engine 16 then fetches 
the 32 bit word 42 stored in the normal primary dictionary 22 at the address E indicated by 
1 1 bit stream A' and forwards it to the processor 12. 

[0023] Code word 34 includes the 4 bit header "01 10", an 1 1 bit stream A' (bits 4-14) and a 5 bit 
stream Y (bits 15-19). Similar to the code word 32, the 1 1 bit stream A' in code word 34 
identifies an address in the normal primary dictionary 22 at which a particular 32 bit word 
is stored. However, the 5 bit stream 7 identifies an address in the short difference 
dictionary 24 at which a difference bit stream is stored that will enable the compression 
engine 16 to calculate the 32 bit word that the processor 12 has requested. The 5 bit length 
of bit stream 7 enables a total of 32 addresses at which 32 bit words may be stored in short 
difference dictionary 24. In the preferred embodiment, the compression engine calculates 
the requested 32 bit word by performing an exclusive-OR (XOR) function on the 32 bit 
word located at the address in normal primary dictionary 22 indicated by the 1 1 bit stream 
A' and the 32 bit word located at the address in the short difference dictionary 24 indicated 
by the 5 bit stream Y. The resulting 32 bit word is the word that has been requested by the 
processor 12. This operation is schematically shown in Fig. 4C . The code word 34 is 
received by compression engine 16, which identifies the code word as a 20 bit reference to 
the entry in the normal primary dictionary 22 and to the short difference dictionary 24 
based on the header "01 10". Compression engine 16 then fetches the 32 bit word 42 stored 
in the normal primary dictionary 22 at the address E indicated by 1 1 bit stream A' and the 32 
bit word 44 stored in the short difference dictionary 24 at the address C indicated by 5 bit 
stream 7. Compression engine 16 then performs an XOR function 46 on the words 42 and 
44 to calculate the 32 bit word 48, which is then forwarded to the processor 12. 

[0024] Code word 36 includes the 4 bit header "01 1 1 ", an 11 bit stream A' (bits 4-14) and a 9 bit 
stream Z (bits 15-23). Similar to the code word 32, the 1 1 bit stream A' in code word 34 
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identifies an address in the normal primary dictionary 22 at which a particular 32 bit word 
is stored. The 9 bit stream Z identifies an address in the normal difference dictionary 26 at 
which a difference bit stream is stored that will enable the compression engine 16 to 
calculate the 32 bit word that the processor 12 has requested. The 9 bit length of bit stream 
Z enables a total of 512 addresses at which 32 bit words may be stored in normal difference 
dictionary 26. In the preferred embodiment, the compression engine calculates the 
requested 32 bit word by performing an exclusive-OR (XOR) fiinction on the 32 bit word 
located at the address in normal primary dictionary 22 indicated by the 1 1 bit stream A" and 
the 32 bit word located at the address in the normal difference dictionary 26 indicated by 
the 9 bit stream Z. The resulting 32 bit word is the word that has been requested by the 
processor 12. This operation is schematically shown in Fig. 4D. The code word 36 is 
received by compression engine 16, which identifies the code word as a 24 bit reference to 
the entry in the normal primary dictionary 22 and to the normal difference dictionary 26 
based on the header "01 1 1". Compression engine 16 then fetches the 32 bit word 42 stored 
in the normal primary dictionary 22 at the address E indicated by 1 1 bit stream A" and the 32 
bit word 50 stored in the normal difference dictionary 26 at the address D indicated by 9 bit 
stream Z. Compression engine 16 then performs an XOR function 46 on the words 42 and 
50 to calculate the 32 bit word 52, which is then forwarded to the processor 12. 

[0025] An example of the decompression of a code word 36 is as follows. A code word received 
by compression engine 16 is: 

0111 00101111011 100101100 
(Spaces have been inserted between the different portions of the code word to simplify 
the description of the example.) Upon receiving the code word, compression engine 16 
determines, based on the header "0111", that what follows is an 1 1 bit address of an entry 
in the normal primary dictionary 22 followed by a 9 bit address of an entry in the normal 
difference dictionary 26. Accordingly, compression engine accesses address 
00101 111011 in normal primary dictionary 22 and retrieves the 32 bit word 42: 

0001 1 1 101 1 100100001001 1 1 1001 1 101 . 
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Compression engine 16 then accesses address 100101 100 in normal difference dictionary 
26 and retrieves the 32 bit word 50: 



1000001 10001 1 1 1001 1 1000000100100. 



The XOR function 46 is then performed on words 42 and 50: 



0001 1 1101 1 100100001001 1 1 1001 1 101 (word 42) 
XOR 1000001 10001 1 1 1001 1 1000000100100 (word 50) 
10011101111110100101011110111001 (word 52) 

The result of the XOR operation, word 52, is then forwarded to the processor 12. 

[0026] Based on this compression algorithm, it can be seen that the following compression ratios 
can be realized: 



Compression Ratio 

Code Word Type Length (Bits) (Compared to 32 Bit Word^ 

Short Primary Dictionary 2 93.75% 

Normal Primary Dictionary 12 62. 5% 

Short Difference Dictionary 20 37.5% 

Normal Difference Dictionary 24 25% 



[0027] The above describes the decompression of single code words which represent 32 bit words. 
In typical operation, however, the compression engine 16 decompresses cache lines that 
include several 32 bit words. This decompression involves the decoding of each single 
word after determining where in the compressed data the first code word for the cache line 
resides. Determining where the first code word in a cache line resides is done using an 
inverse location table, such as is shown at 60 in Fig. 5. Inverse location table 60 contains, 
for each cache line number, which is the address of the cache line divided by the size of the 
cache line, the bit number of the first compressed code word for that cache line. The 
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information in inverse location table 60 can also be compressed by dividing the table into 
segments, as shown at 62 in Fig. 5, in which the table is divided into quarters. Accordingly, 
the compressed data referred to by each quarter of the table must be in the respective 
quarter of the memory. In order to reduce the drain of the inverse location table on the 
efficiency of the compression algorithm, cache lines can be made larger. For example, if 
the size of a cache line is doubled, the size of the inverse location table would be cut in half 

[0028] As set forth above, the short primary dictionary 20 contains the most frequently accessed 
data word and the normal primary dictionary 22 contains data words that are more 
frequently accessed by the processor 12. Ideally, the short difference dictionary 24 and the 
normal difference dictionary 26 are filled with difference bit streams that enable a 
maximum number of data words to be encoded. In the present embodiment, the 
differences that will be used to decode the code words are calculated against the primary 
dictionaries using a weighting scheme that forces a clustering of the differences, which 
enables a best difference to be determined for each data word that cannot be encoded. The 
most popular of these "best" differences are inserted into the difference dictionaries. 

[0029] The preferred weighting scheme involves searching for difference bit streams that have the 
minimum number of bits required for converting the data words stored in the primary 
dictionaries to the desired decoded data word. Typically, the number of bits required to 
convert data words in the primary dictionaries is approximately 1 to 10 bits. This is 
because the weighting of the minimum number of bits causes the lower nimiber of bits to be 
selected more often. Once the minimum number of bits have been found, further clustering 
of the many possible difference bit streams is attained by weighting the bits and the 
distance between adjacent bits. The preferred weighting function involves, for each set bit 
in the difference, adding the weight or index of the bit to the square root of the distance 
between the bit and the preceding set bit, which is the difference of the indexes, multiplied 
by 32. The parameters of this weighting function are shown schematically in Fig. 6. Once 
the primary and difference dictionaries are filled, the compression device 16 is able to 
encode each data word of the instruction set, while building the inverse location table 60, as 
described above. 
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[0030] Accordingly, the present invention provides a method of and system for performing lossless 
compression in which the most frequently accessed data words are stored in a primary 
dictionary and in which shortened code words are used to access these data words. 
Difference dictionaries are used to store difference bit streams which are accessed by code 
words which identify a data word in the primary dictionary and a difference bit stream in 
one of the difference dictionaries. An exclusive-OR operation is performed on the 
identified data word and the difference bit stream to calculate a decoded data word that is 
not stored in either the primary or difference dictionaries. 

[0031] The invention may be embodied in other specific forms without departing from the spirit or 
essential characteristics thereof For example, although an exclusive-OR operation is 
performed to decode the data words in the preferred embodiment, it will be understood that 
any logic operation may be used to manipulate the stored data words to obtain data words 
that are not stored in the dictionaries. Furthermore, the arrangement of dictionaries and the 
bit lengths of the various bit streams may be different in order to accommodate the storage 
of greater or lesser data words and difference bit streams in the dictionaries. The 
specifically disclosed code word format is not intended to be limiting and therefore 
altemative, functionally equivalent, formats may be employed. The present embodiments 
are therefore to be considered in respects as illustrative and not restrictive, the scope of the 
invention being indicated by the appended claims rather than by the foregoing description, 
and all changes which come within the meaning and range of the equivalency of the claims 
are therefore intended to be embraced therein. 
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